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Abstract — This paper studies the Lagrange stabilization of a 
class of nonlinear systems whose linear part has a singular system 
matrix and which have multiple periodic (in state) nonlinearities. 
Both state and output feedback Lagrange stabilization problems 
are considered. The paper develops a pseudo Hoo control theory 
to solve these stabilization problems. In a similar fashion to 
the Strict Bounded Real Lemma in classic Hoo control theory, 
a Pseudo Strict Bounded Real Lemma is established for systems 
with a single unstable pole. Sufficient conditions for the synthesis 
of state feedback and output feedback controllers are given 
to ensure that the closed-loop system is pseudo strict bounded 
real. The pseudo-//c« control approach is applied to solve state 
feedback and output feedback Lagrange stabilization problems 
for nonlinear systems with multiple nonlinearities. An example 
is given to illustrate the proposed method. 

Index Terms — Pseudo-/foo control, Pseudo Strict Bounded Real 
Lemma, Pendulum-like systems, Lagrange stability. 



I. Introduction 

The class of pendulum-like systems is a class of nonlinear 
systems with periodic (in state) nonlinearities and an infinite 
number of equilibria fTl. They cover an important class of 
nonlinear systems arising in electronics, mechanics and power 
systems. These systems can be used to model interconnected 
oscillators, synchronous electrical machines and electronic 
phase-locked loop devices 111, fH. An important control objec- 
tive in relation to controlling such systems is to ensure that the 
closed-loop system retains the properties of a pendulum-like 
system and its trajectories are bounded, at least, in the sense of 
Lagrange stability. In combination with other analytical tools, 
this enables global asymptotic properties of the system to be 
established. For example, the monograph 1 1 1 makes extensive 
use of this approach to study global asymptotic behavior of 
nonlinear systems with periodic nonlinearities and an infinite 
number of equilibria. 

The concept of Lagrange stability can be traced back to H. 
Poincare's work in the 1890s |4|. In ||5l, Lagrange stability 
is defined as a property of a state jcq of a dynamical system 
i = f{t,x) given on a metric space S^, which requires that 
the system trajectory x — x{f,t,xo) originating at this state 
XQ to be contained in a bounded set. It is shown in [1] that 
if a pendulum-like system possesses both Lagrange stability 
and dichotomy, then it has a so-called gradient-like property. 
The gradient-like property guarantees that any trajectory of the 
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pendulum-like system eventually converges to an equilibrium. 
This is analogous to the asymptotic stability of a system with a 
single equilibrium. This observation highlights the importance 
of Lagrange stability as a tool to establish the gradient-like 
property of pendulum-like systems. It also motivates the study 
of pendulum-like systems within the framework of Lagrange 
stability which is considered in this paper 

In the authors' previous work |6|, the state feedback con- 
troller synthesis problem is considered for a restricted class of 
pendulum-like systems in which the way that the controlled 
outputs enter into the nonlinearities must have a special 
structure. In contrast to the results in |l6l, this paper mainly 
focuses on solving the output feedback Lagrange stabilization 
problem for pendulum-like systems with nonlinearities which 
have a general structure. Unlike the special case in Q, in this 
more general case, a significantly different method utilizing 
sign-indefinite solutions to game-type Riccati equations is nec- 
essary. This has led us to develop a pseudo-//oo control theory 
to address the Lagrange stabilization problem of pendulum- 
like systems. This pseudo-//oo control theory allows a pole 
of the closed-loop transfer function to be located in the right 
half of the complex plane and ensures that the closed-loop 
transfer function satisfies a frequency domain condition which 
is similar to the bounded real property |7|. An important 
contribution of this paper is the pseudo strict bounded real 
results in Theorems 13.11 and 13.21 which are analogous to 
the standard strict bounded real lemma IS]. Our pseudo-//oo 
control theory can be regarded as a theory which is analogous 
to the standard Hoo control theory (see 13, ifTOl ) but with 
a non-standard closed-loop stability condition. Furthermore, 
the paper applies the proposed pseudo-//oo theory to solve the 
Lagrange stabilization problem for pendulum-like systems. 

The usefulness of the Lagrange stability property of 
pendulum-like systems motivates research on Lagrange sta- 
bilization of pendulum-like systems; e.g., see lO, ifTTI - lfTSJI . 
However, in these papers it was assumed that the nonlinear 
system contains a single nonlinearity only and has a special 
matched structure on its nonlinearity. This special matched 
structure enables the Lagrange stabilization problem to be cast 
as a standard Hoo problem. In order to consider general system 
structures which do no satisfy matching conditions, a different 
approach is required which motivates our pseudo Hoo control 
problem. Also, the results of Q, ifTTl - lfTSl are established 
using a Lagrange stability criterion given in IT) which requires 
the linear part of the system to be minimal. This means that a 
post-check is required on the linear part of the resulting closed- 
loop system to determine if it is minimal. In contrast, this paper 
uses a Lagrange stability criterion which does not have the 
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minimal realization requirement but uses a strict frequency- 
domain condition. This Lagrange stability theory enables this 
paper to consider a Lagrange stabilization problem without the 
requirement of a post-check on the minimality of the linear 
part of the closed-loop system. Also, this Lagrange stability 
criterion allows us to solve the Lagrange stabilization problem 
for nonlinear systems with multiple nonlinearities. Indeed, a 
condition of the stability analysis techniques used in the paper 
is that the closed-loop system matrix A has a single zero 
eigenvalue, even though multiple nonlinearities are allowed. 
The corresponding condition on the open-loop system in our 
control synthesis results is that this system must have a single 
unobservable (or uncontrollable) mode at the origin. 



To illustrate the efficacy of the proposed method, we give 
an example. It is concerned with Lagrange stabilization of 
a network of three interconnected nonlinear pendulums. Also, 
this system has some of the features of many practical systems 
such as power systems, large-scale interconnected networks 
and hence it suggests some application areas for the theory 
developed in this paper. These features are an interconnection 
of nonlinear but not identical elements, and the existence 
of multiple equilibria points due to the periodicity of the 
nonlinear elements. 



This paper is organized as follows: Section II formulates 
the Lagrange stabilization problem for pendulum-like systems; 
Section III presents a pseudo Hoo control theory, which is 
motivated by the problem formulated in Section 2; Section 

IV presents our main results on output feedback Lagrange 
stabilization of unobservable pendulum-like systems; Section 

V presents our results on the output feedback Lagrange 
stabilization of uncontrollable pendulum-like systems; Section 

VI gives results on the state feedback Lagrange stabilization 
of uncontrollable pendulum-like systems. Section VII presents 
an example to illustrate the efficacy of the proposed method 
and Section VIII concludes this paper. All of the proofs of the 
theorems in the Sections II- VI are contained in the Appendix. 



Notation: ^ denotes the set of integers. ^"^^ and ^"^^ 
denote the space of n x m real matrices and the space of n x m 
complex matrices, respectively. ^ denotes the set of rational 
numbers and ^'" denotes the set of vectors of m rational 
numbers. o{A) denotes the set of the eigenvalues of a matrix A. 
Cmoji'] denotes the maximum singular value of a matrix. M-J^^ 
denotes the space of all proper and real rational stable transfer 
function matrices. Sl+ denotes the set of positive real numbers 
and ^" — (i^+)". p(^) denotes the spectral radius of the 
matrix X. diag[fli, • • • ,«„] is a diagonal matrix with oi, • • • ,a„ 
as its diagonal elements. B(fl,e) denotes a neighborhood 
ai-ound a S ^", defined as {a £ ^" : ||fl — fl|| < e}. Given a 
vector T = [ti , • • • , T„,] e ^™, M^ denotes the diagonal ma- 
trix Mt = diag [ti , • • • , T,„] . Similarly, M^ = diag [jUi , • • • , ^u^] . 
Given a vector v e =S", LCMD(v) denotes the least common 
multiple (LCM) of the denominators of all the elements of v. 



II. Problem Formulation of Lagrange 
Stabilization for Pendulum-like System 

A. Pendulum-like Systems 

We consider a class of nonlinear systems defined as follows: 



i = Ax + Bw, 

z = Cx, 



(1) 



where x G M" is the state, z G .^"' is the nonlinearity output 
vector and w G .^™ is the nonlinearity input vector. Also, A G 

^"><", B G ^"^'", c = [c\, ■ ■ ■ ,clY e ^'"''", Ci G ^1^'",/ = 

1 , • • • ,m. The components of the vector w — [vvi , • • • , w,,,] ^ are 
determined from the corresponding components of the vector 
z= [zi,--- TZm]"^ via nonlinear functions 



^iit,Zi) 



(2) 



where 0, : ^+ x ^ -> .^ is a continuous, locally Lipschitz in 
the second argument and periodic function with period A, > 0; 



I.e., 



(pi {t,zi + Ai) = (pi it,Zi) , Vf G ^+, Zi G ^. 



(3) 



This type of nonlinearity appears frequently in the practical 
engineering systems mentioned in Section U Phase-locked 
loops |14J and a pendulum system with a vibrating point 
of suspension fTJ are typical examples of such systems. We 
also refer to the example given in Section IVIII The transfer 
function of the linear part of the system ([TJ is given by G{s) — 
C{sl —A)^^B. The nonlinear functions (j)i{t,Zi),i — I,-- ,m, 
are assumed to satisfy the sector conditions, 

<l>it,Zi) 



-fii< 



< fii, Vf G , 



Zi^O, 



(4) 



where fii G ^+ ,i — 1 , • • • ,m. 

We define A G ^'"'"" as A = diag[Ai,--- ,A,„]. Given a 

vector d G ^", let n{d) = {kd\k G ^}. 

Definition 2.1: (Pendulum-like System (J^) The nonlinear 
system ([T]l, (|2]i, ^ is pendulum-like with respect to Yl{d) if 
for any solution x(f,fo,xo) of ([B, ©, (O with x(fo) — xq , 
we have x{t ,t(,,X(,) ~\- d = x{t ,tQ,X(, + d), for all t >to, and all 
deU{d). 

Remark 2.1: This definition reflects the fact that the phase 
portrait of a pendulum-like system is periodic. For example, 
in the case of a simple pendulum, this means that its position 
variable can be represented by an angle between and 2n. 

Definition 2.2: (Lagrange Stability [1]) The nonlinear sys- 
tem ([T]i, ^ is said to be Lagrange stable if all its solutions 
are bounded. 

B. Lagrange Stabilization Problem for Pendulum-like Systems 

The pendulum-like system to be stabilized will be a con- 
trolled version of the nonlinear system ([TJ, (|2]i, ([3]), (|4]i. That is, 
the linear part of the system is described by the state equations 



X ~ 


= AX+B2U+B1W, 


(5a) 


z 


= Cix + Dx2U, 


(5b) 


y = 


- C2X + D21W, 


(5c) 
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where x £ ^", w G ^"', z G .^'" are defined as in O, m G M'^ 
is the control input, and y e ^p is the measured output. Here, 
all the matrices are assumed to have compatible dimensions. 
Also, the components of the nonlinearity input w are related 
to the components of the system output z as in (|2]i and 
the nonlinearities 0, have the property (O. Furthermore, the 
nonlinearities are assumed to satisfy the sector condition (|4|. 
The system block diagram is shown in Figure [T] 



Wl 



<^i 1^ 



Zl 



Zm 



Linear System 



K{s) 



Fig. 1. Nonlinear control system with periodic nonlinearities. 

Problem 1: (Output Feedback Lagrange Stabilization) The 
output feedback Lagrange stabilization problem for the non- 
linear system (|5]l, Q, (|3]l, dU is to design a linear controller 
with the transfer function K{s) and state-space realization: 



Xc = AcXc+Bcy 

14. — \^^ (-Jv £ 



(6) 



such that the resulting closed-loop system is pendulum-like 
and Lagrange stable. 

Problem 2: (State Feedback Lagrange Stabilization) The 
state feedback Lagrange stabilization problem is to design a 
state feedback control law u = Kx for the system dSal i. dSbl i. 
©, (|3]l, (IHl to ensure that the resulting closed-loop system is 
pendulum-like and Lagrange stable. 

Note that in some cases, it may be possible to design a 
controller in the form of ^ to asymptotically stabilize the 
system (|5]l, (|2]i, (|4|i. Such cases are trivial from the point 
of view of Lagrange stabilization. In order to rule out these 
trivial cases and to guarantee that the closed-loop system is a 
pendulum-like system, we will assume that the linear part of 
the systems (|5]l has uncontrollable or unobservable modes. 

To solve the above two problems, the following two tech- 
nical results of f6l will be used: 

Lemma 2.1: ( [6|) Consider the nonlinear system ^, (|2|i, 
©. Suppose detA — and there exists a vector d ^Q such 
that At/ = 0, CJ 7^0,/= l,--,m, and (A)"^CJe .^'". Also, 
let -T^ = — for all / = 1, • • • ,ot, where p., qi ^ are integers. 

Cjd q\ 7 1' i'C 1! T- & 

Let p be the LCM of ;?,, / = 1, • • • ,m. Then, the system ([TJ, 
(l2]i, (|3]i is pendulum-like with respect to n((i) where d = pd. 
Lemma 2.2: ( |6|) (Lagrange Stability Criterion) Suppose 
the system ^, (|2]), (|3]l, (|4]l is a pendulum-like system. 
Also, suppose there exist a constant A > and a vector 
T = [ti , • • • , T,„] e ^™ satisfying the following conditions: 

i. A + A/ has n — 1 eigenvalues with negative real parts 

and one with positive real part; 



ii. G^ {-j(0-k)MrG{j(0-X) <M^^MrM^\ for all 
co>0. 
Then, the nonlinear system ([U, (|2|l, (O, (|4| is Lagrange stable. 

The proofs of these two results appear in the journal version 
of |6| but are included in the Appendix for completeness. 

Lemma 122] is the key result to establish Lagrange stability 
of the closed-loop systems under consideration. It involves a 
frequency domain condition, which is similar to the bounded 
real property in |7|, and a system state matrix A + Xl which 
has one unstable eigenvalue. However, it does not require the 
minimality of the linear part of the system ^. To establish 
these conditions in the Lagrange stabilization problems 1 and 
2, we develop a pseudo-//„o control theory in the next section, 
which is analogous to the standard Hoo control theory. 

III. PsEUDO-Hoo Control 

A. The Pseudo Strict Bounded Real Property and the Corre- 
sponding Strict Bounded Real Lemma (SBRL) 

The bounded real property is an important concept fre- 
quently used in the standard H,„ control theory. We begin our 
development of pseudo Hoo control with the definition of the 
pseudo strict bounded real property, which is analogous to the 
standard bounded real property. 

Definition 3.1: A matrix A G ^"^" which has « — 1 eigen- 
values with negative real parts and one eigenvalue with posi- 
tive real part is said to be pseudo-Hurwitz. A symmetric matrix 
P G ^"^" is said to be pseudo-positive definite if it has n — 1 
positive eigenvalues and one negative eigenvalue. 

Definition 3.2: A linear time-invariant (LTI) system ([T|i is 
called pseudo strict bounded real if the following conditions 
hold: 

(i) A is pseudo Hurwitz; 

(ii) 



m?ix{a„u,x[G{-j(oYG{i(o)]} < 1. 



(7) 



Theorem 3.1: Consider the LTI system ([T]i. If the Riccati 
equation 

A^P + PA + PBB^P + C^C^O (8) 

has a solution P ^ P^ such that P is pseudo-positive definite 
and A + BB^P has no purely imaginary eigenvalues, then the 
system ([T]i is pseudo strict bounded real. 

Theorem 3.2: If the LTI system ([l]) is pseudo strict bounded 
real, then 

1) There exists a pseudo-positive definite matrix P — P^ 
such that 



A^P- 



PA 



pbb'^p 



C^C<0. 



(9) 



2) Furthermore, if in addition the pair (A,B) is stabilizable 

and the pair {A,C) is observable, then the Riccati equation 

([8j has a stabihzing solution P which is pseudo-positive 

definite. 

Theorem |3.1| is analogous to the sufficiency part of the strict 

bounded real lemma for systems with non-minimal realizations 

|8|. Also, Theorem 13.21 is analogous to the necessity part of 

the strict bounded real lemma for systems with non-minimal 
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realizations. Theorems 13.11 and 13.21 are together called the 
pseudo strict bounded real lemma. 

The pseudo strict bounded real lemma gives a relationship 
between state-space conditions, such as solvability of ([8]) and 
pseudo-Hurwitzness of A, and the frequency-domain inequal- 
ity (|7]). This will allow us to replace the frequency domain 
condition for the closed-loop system that will appear in the 
application of Lemma 12.21 with a condition in the state-space 
form. This is a key step in the derivation of a solution to 
Problems 1 and 2. 

B. State Feedback Pseudo-Hoa Control 

The state feedback pseudo-//oo control problem for the LTI 
system ( fSab . ( fSbl i involves designing a state feedback law 
u — Kx which ensures that the corresponding closed-loop 
system is pseudo strict bounded real. In an analogous way 
to Hoo control theory |9|, |10|, the main result of this section 
presented in the following theorem, gives a sufficient condition 
for the existence of a solution to the problem. 

The following assumption is made on the system (l5al l. dSbl i: 

Assumption 3.1: Ei —D\^D\2 > 0. 

Theorem 3.3: Suppose Assumption ^ . 1 I holds for the system 
dSab , ( Bbl ) and the Riccati equation 

{A-B2E^'D]2CifP + P{A-B2E-'Dj2Ci) 
+P{BiB\^B2E^^Bl)P + C\{I-DnE^^D\2)Ci=0 

(10) 

has a solution P = P^ such that P is pseudo-positive definite 
and the matrix 

A~B2E-^Dj2Ci + {BiBj-B2E-^Bl)P (11) 

has no purely imaginary eigenvalues. Then, the state feedback 
control law 



M = -£f'(B|'P + D[2Ci)x 



(12) 



solves the state feedback pseudo-//oo control problem. That is, 
the resulting closed-loop system is pseudo strict bounded real. 
Remark 3.1: In practice, it is usually convenient to use the 
stabilizing solution to the Riccati equation ( fTOl i in order to 
construct the required state feedback control law ( fT2l l. 

C. Output Feedback Pseudo-Hoc Control 

Analogous to the standard output feedback //«, control 
problem, the output feedback pseudo-//oo control problem for 
the system (|5]l involves designing a compensator of the form 
(|6]l to make the corresponding closed-loop system pseudo 
strict bounded real. The following two theorems each give a 
sufficient condition for the existence of a solution to the output 
feedback pseudo-//oo control problem for a system of the form 
(|5]l. Besides Assumption 13. II the following assumption is also 
made on the system (|5]): 

Assumption 3.2: E2 — D2\D^^ > 0. 

Theorem 3.4: Suppose the system (|5]l satisfies Assumptions 
13.11 and 13.21 and the following conditions are satisfied: 



(i) The Riccati equation 

{A-B2E{^Dl2CifX+X{A-B2E{^Dl2Ci) 
+X{BiB\-B2E^^bI)X 
+C\{I~DnE^^D\2)Ci^0 (13) 

has a stabilizing solution X = X^ which is pseudo- 
positive definite; 
(ii) The Riccati equation 

{A~BiDliE^^C2)Y + Y{A-BiDliE2^C2f 
+Y{C\Ci-ClE^^C2)Y 
+Bi[I-DI^E^^D2i)B\=Q (14) 

has a stabilizing solution Y = Y^ which is positive 
definite; 
(iii) The matrix XY has a spectral radius strictly less than 

one, p{XY) < 1. 
Then, there exists a dynamic output feedback compensator 
of the form (|6]l such that the resulting closed-loop system is 
pseudo strict bounded real. Furthermore, the matrices defining 
the required dynamic feedback controller ^ can be con- 
structed as follows: 



A, = A+B2C,-BcC2 + {Bi-B,D2i)B{X, 

-,T 



B, = {I-YX)-'iYCl+BiDli)E^\ 



Cc - -E;\bIx+d\2Ci). (15) 

Theorem 3.5: Suppose the system (|5]i satisfies Assumptions 
3.11 and 13.21 and the following conditions are satisfied: 

(i) The Riccati equation ( fT3] l has a positive definite 

stabilizing solution X =X^; 
(ii) the Riccati equation ( fl4] i has a pseudo-positive defi- 
nite stabilizing solution Y —Y^ ; 
(iii) The matrix XY has a spectral radius strictly less than 
one, p{XY) < 1. 
Then, there exists a dynamic output feedback compensator 
of the form ^ such that the resulting closed-loop system is 
pseudo strict bounded real. Furthermore, the matrices in the 
required dynamic feedback controller (|6| can be constructed 
as follows: 



Ac 



A+BcC2-B2Cc + YC\{Cx -DnCc), 



Be = -{YCI+b\dI,)E^\ 

C, = E-\BlX+D'{2Ci){I~YX)-\ 



(16) 



Remark 3.2: According to flSl, the stabilizing solutions to 
the Riccati equations (fT3] l and (fl4] i are unique, if they exist. 

IV. Output Feedback Lagrange Stabilizing 
Controller Synthesis for Unobservable Systems 

In this section, the output feedback pseudo H„ control 
theory developed in the previous section is used to solve 
Problem [T] for nonlinear systems satisfying the following 
assumptions, which will be used to ensure that the closed- 
loop system is pendulum-like and to rule out trivial cases in 
which the nonlinear system can be asymptotically stabilized: 

Assumption 4.1: There exists a non-zero vector x such that 
Ax — Q and C2X = 0. 
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Assumption 14. 1 1 implies that (A,C2) is unobservable and the 
origin is an unobservable mode. Using the Kalman decompo- 
sition in the unobservable form 1 16], it follows that there exists 
a non-singular state-space transformation matrix T such that 
the system matrices of the system (|5]l are transformed to the 
form 



A = 



Ci 



T-^AT ^ 



T'Bi 

CiT = 
C2T = 



\ Ai 


0] 


A2 


Bla 




[ Bib \ 


1 



Cla Cib 
Cla 1 , 



B2^T-^B2 = 



|, Di2=Dn, 

521 =£'21, 



B2a 
B2b 



(17) 



where Aj £ ^(«-Ox(n-0, Bu, e Mi"->)>^''\ B2a G M^"-^^'"', 

Also, let e„ = [ Oix(„_n 1 Y . We define two vectors % = 
CiTcn and d = [Oix„ e^r^^ € M^". 

Assumption 4.2: There exists a constant Tq > such that all 
the elements of the vector v = TqA^'j are non-zero rational 
numbers. 

Remark 4.1: In the case where the coefficients in the system 
(|5]l are all rational numbers, Assumption 14.21 amounts to an 
assumption that the periods of the nonlinearities are commen- 
surate. 

The main result of this section involves the following Riccati 
equations dependent on parameters A > and T, > 0, i — 
I,--- ,m: 

{Xl+A-B2E^'^D{2MrCifX+X{Xl+A~B2E{^D{2M-,Ci) 
+X[BiM^,M-^M^B\-B2E^^bI)X 



+C{ iM,-M,Di2E{'D{2M,)Ci=0, 

{XI +A - BiM^m:;^m^dIiE2^C2)y 

+Y{Xl + A-BiM^M-^M^DliE2;^C2Y 
( M,M-'M,B\ 
\ ^M^M-^M^Dl^E2'D2iM^M-^M^ ' i 



(18) 



-Y{C\M,Ci-CIE2^C2)Y = 0, 



(19) 



where £1 = DfjM^Dn and £2 = £>2iM^M^'M^£>[i- If these 
Riccati equations have suitable solutions, we will define the 
parameter matrices of the controller (|6]l as follows: 



A, ^ A+B,C2-B2Cc + YCl{MrCi-MrDi2Cc), 

B, = -{YCl+BiM^M-'M^Dl^)E2\ 



c, = e-\bIx+d'{2M^Ci){i~yx)-\ 



(20) 



The following theorem, which is the main result of this 
paper, gives a sufficient condition for the existence of a 
Lagrange stabilizing controller for the nonlinear system (|5]), 
©, ©, ® : 

Theorem 4.1: Suppose Assumptions 13.11 13.21 14.11 and 14.21 
hold for the nonlinear system (|5]l, (|2|i, Q, ^. Also, suppose 
there exist constants A > and T, > 0, i — 0,- ■ ■ ,m such that 
the following conditions are satisfied: 

I. The Riccati equation (fTSl l has a stabilizing solution 

X = X^ which is positive definite; 



II. The Riccati equation ( fT9] l has a pseudo-positive 
definite stabilizing solution Y = Y^; 

III. The matrix XY has a spectral radius strictly less than 
one, p{XY) < 1. 

Then, the resulting closed-loop system corresponding to the 
controller (|6]l, (|20| | is a pendulum-like system with respect to 
n(To/5ii) and is Lagrange stable. Here p = LCMD(v). 

V. Output Feedback Lagrange Stabilizing 
Controller Synthesis for Uncontrollable 

Systems 

In this section, the state feedback and output feedback 
pseudo //oo control theories in Section |lll] are applied to 
Lagrange stabilization for nonlinear systems satisfying the 
following assumption which is dual to Assumption 14. II 

Assumption 5.1: There exists a non-zero vector x such that 
x^A = and x^ B2 = 0. 

In a similar way to Assumption 14.11 this assumption is 
also used to ensure that the closed-loop system is pendulum- 
like and to rule out trivial cases in which the system can be 
asymptotically stabilized. Also, this assumption implies that 
(A,B2) is not controllable. Using the Kalman Decomposition 
|16i|, it follows from Assumption 15 . II that there exists a non- 
singular state-space transformation matrix f such that the 
matrices of the system ^ are transformed to the form 



A = 



Bi 

5l2 

C2 



T-^AT = 



T'^Bi 



■ Ai 


A2 ■ 





Bla 




Bib 





B2 — T B2 — 



B2a 




Dl2,Ci —CiT— [ Cla Cib \ , 
C2T = \ C2a C2b 1 , -S21 =-D21, 



(21) 



where Ai G af^-iMn-i)^ ^2 G i^*""''^', B2« G ^^"-'^"1, Bu G 
^("-')^'", Ci„,C2«G^'"^("-''. 



A. Output Feedback Lagrange Stabilization for Uncontrol- 
lable Systems 

The main result of this section involves the Riccati equations 
( fTSb and ( fT9] l which are dependent on parameters A > and 
T,- > 0, / = 1 , • • • , m. Using solutions X and Y to the equations 
(fTSl l and ( fT9] l , we can construct the following matrices: 

Ac = A + B2Cc-BcC2 

-{BiM^,M-^M^-B,.D2iM^M-^M^)B\X, 



Be 

Cc 



{I -YX)-\YCl +BiM^M-'M^Dl,)E2\ 



E-\BiX+D{2M^Ci). 



(22) 



Also, we define two vectors of constants: 



do = - 
X = \ 



Ac BcC2a BcC2b 

B2aCc Ai \ [ A2 

\BlX+D\2MrCi) Ci ]d, (23) 



-DnE^ 



where d 




T 



do 
1 



with T defined in the Kalman 



decomposition ( |2T] ). Using this notation, a sufficient condition 



IEEE TRANSACTION ON AUTOMATIC CONTROL, MANUSCRIPT FOR REVIEW 



for the solution to the output feedback Lagrange stabilization 
Problem 1 can now be presented: 

Theorem 5.1: Suppose Assumptions 13.11 13.21 and 15.11 hold 
for the system (|5]), Q, (O, (|4|i. Also, suppose there exist 
constants A > and T,-, / = 0, • • • ,»j such that the following 
conditions are satisfied for the nonlinear system dU, (OJ, Q, 
®: 

I. 



II. 



III. 



IV. The matrix 



is non-singular and 



The Riccati equation (fTsT i has a stabilizing pseudo- 
positive definite solution X =X^\ 
The Riccati equation (fT9] l has a stabilizing solution 
Y = Y^ which is positive definite; 
The matrix XY has a spectral radius strictly less than 
one, p{XY) < 1; 

Ac BcCla 

BlaCc Ai 

all the elements of the vector v = TqA^^x ^^ non- 
zero rational numbers, where Ac, Be, Cc and x ^6 
defined in (|22]i and (|23]l using X, Y in I, II and III. 

Then, the closed-loop system consisting of the system (|5]l, (|2|i, 
dD, & and the controller (|6]l, (|22] | is a pendulum-like system 
with respect to n;^ ~ {pTod} and is Lagrange stable. Here 
p = LCMD(v). 

B. Satisfaction of the rationality condition. 

Theorem 15.11 gives sufficient conditions for the existence 
of a solution to the Lagrange stabilizing controller synthesis 
problem for a nonlinear system satisfying Assumption 15.11 
However, the question arises as to whether, given A > 0, there 
will exist positive constants T,-, 0= I,-- ,m, such that the 
stabilizing solutions to the Riccati equations ( fTSl l and (fT9] l 
satisfy the rationality condition IV of this theorem. 

First, we demonstrate that such i — [ti , • • • , T„,]^, if exists, 
can be constrained to be a unit vector Given any 7 > 0, let 
t = 7T, 1 = 7X, ? = y-^Y, Mi = jM-,, El = DfjM^Dn and 
El =D2iM^^D2i. Multiplying the Riccati equation ( fTSl ) by 7 
and multiplying iT% by 7^' gives that 

(A + A/ - B2E^^Dj2MiCifx +X{A + Xl- B2E^^D\2MiCi ) 

+C{{Mi-MiDi2E{^D'^2Mi)Ci 

+X{BiM^M7^M^bJ -B2E{^Bl)X = 0, (24) 

{Xl+A-BiM^M^^M^DliE2^C2)Y 

+Y{Xl+A-BiM^M7^M^DliE^^C2f 

+Y{C\MiCi-ClE^^C2)Y 

+Bi[M^M7^M^ -Mt,M^'DliE^'D2iM7'M^)B\ = 0. 

(25) 

It is obvious that (l24l i has the same form as (fTSl l but both X and 
Mt are scaled by 7 Also, ( |25] | has the same form as ( fT9] l but Y 
is scaled by 7^' andM^ is scaled by 7. Hence, Conditions I-III 
in the statement of Theorem 15. II are not affected if we use X, 
Y, Mf, El and E2 to replace X, Y, M^, Ei and E2 respectively. 
In addition, it is straightforward to verify that Condition IV of 
Theorem 15. II is not affected by scaling the vector of constants 
T. Thus, without loss of generality, we assume that T is a unit 
vector throughout the remainder of this section, and if we take 



T; > 0, / = 1 , ■ ■ ■ , m — 1 as independent constants combined into 
the vector f = [ti , • • • , T,„_i], then t,,, is given by 




(26) 



Define 



T: 



TG, 



3m— 1 . 



Equations ( fTSl l and ( fT9l ) have 
nonsingular stabilizing solutions 



Let X— [tq,- • • ,T„,_i] = [to,T"^]"^ and define a function 

/(f) = [ /i(f) •■■ /„,(f) Y = ToA-i;i; on the set F = 

{f : To > 0,f e T}. Let 7(to,Ti,- • • ,T,„_i) be the Jacobian 
matrix of /(f). 



-/(To,Ti,--- ,T,„_i) 





dfi 
7Ti 


dfi 




df,„ . 
dzi 


. df,„ 
dr,,,-, 



(27) 



Then, we have J{t) —A '/(f) and the elements of /(f) are 



, m — 1 ; 




/ 



-3„ 



'^- /,y = l,.--,m-l,/^/ 



m-J 



= '^Q \r '^j^> 



,-1 



5t,- 
= ] 

dw„. 



j=l,---,m. (28) 



The following theorem gives a sufficient condition for 
the existence of the constants To,---,t,„ satisfying all the 
conditions of Theorem 15.11 

Theorem 5.2: Suppose Assumptions 13.11 13.21 and 15.11 hold 
for the system (|5]), (|2]), Q, ^. Also, suppose there exist a con- 
stant A > and a vector of positive constants f = [to, • • • , T,„_i] 
such that the following conditions are satisfied for the system 
©, ©, ©, ©: 

(I) Conditions I, II and III of Theorem ED hold; 

(II) det/(f ) ^ where the elements of /(f) are defined 
as (Elli. 

Then, given any sufficiently small e > 0, there exists f = 
[fo,fi,-'' ,T„,_i] e F such that ||f — f|| < £ and the constants 
To = To, Ti — Ti,i — !,■■■ ,m — I and T,„ (defined as in ( |26] |) 
satisfy all the conditions of Theorem 15. II and hence the corre- 
sponding closed-loop system is pendulum-like and Lagrange 
stable. 

VI. State Feedback Lagrange Stabilization for 
Uncontrollable Systems 

In this section, we give a sufficient condition for the exis- 
tence of a solution to the state feedback Lagrange stabilization 
problem (Problem |2]i of Section II. 

Using a solution to the Riccati equation ( flSl l. we de- 
fine two vectors d ^ T[dl 1]^ and x_= [Xi 'J- XmV = 
{[l-Di2E-^D\2Mr)Ci -Di2E-^BlX)d, where f is defined 
by (I2B and 

do — — (^1— fi2a£'i E>i2M-cCia-B2aEi B2a^ll) 
X (A2 - B2aE^^D\2MrCib - BiaEi^BlJCu) 
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with 



Xu e ^(«-i)x(m-i)^ Xn e i^(«-i)><i defined by 

Xi2 X^22 

Theorem 6.1: Consider the nonlinear system JSal l. ( |5b] l. Q, 
(O, (01 and suppose Assumptions 13.11 and 15.11 are satisfied. 
If there exist constants A > and T, > 0, / = 0, • • • ,m such 
that the Riccati equation ( fTSl ) has a pseudo-positive definite 
solution X =X^ such that 



I. 



II. 



The 



matrix 



II 



B2E^^D\^M,Ci 



{BiM^M-^M^B\ -B2E^^Bl)X is Hurwitz; 



All elements of the vector v : 
rational numbers. 



To A X ^s non-zero 



Then, the closed-loop system corresponding to the state feed- 
back control 



DnE^'DUMrCi 



DnE7^BlP)x 



(29) 



is a pendulum-like system with respect to 11 [px^d) and is 
Lagrange stable, where p = LCMD(v). 

In a similar way to Theorem 15.21 a sufficient condition for 
the existence of constants To, • • • , Tm satisfying Condition II of 
Theorem 16.11 is now given. The proof of this result is similar 
to that of Theorem 15.21 and is omitted. 

Theorem 6.2: Consider the system (|5ali, ( Bbl ). Q, (O, ^ 
and suppose Assumptions 13. 1115. H are satisfied. Also, suppose 
there exists a constant A > and a vector of positive constants 
f = [to, • • • , T,„_i] satisfying the following conditions: 

I. The Riccati equation (fTSl ) has a pseudo-positive 
definite stabilizing solution X; 

II. /(f) 7^ where /(f) is defined in (|28]l. 

Then, given any sufficiently small e > 0, there exists a 
f = [fo,fi,--- ,f„,_i] e F such that ||f-f|| < e and the 
constants To = To, T; = f,,/ = 1, • • • ,m — 1 and T„, (defined as 
in ( |26] |) satisfy all the conditions of Theorem 16.11 and hence 
the corresponding closed-loop system is pendulum-like and 
Lagrange stable. 

VII. Illustrative Example 

To illustrate the theory developed in this paper, we consider 
a system consisting of three connected pendulums, as shown in 
Figure |2] where the pendulums are connected using torsional 
springs and both pendulums and springs are supported by a 
rigid ring. The pendulums oscillate in planes perpendicular 
to the ring and the torsional torque of the springs obeys the 
angular form of the Hooke's law F = —kAO, where A0 is the 
angular displacement, F is the spring torque and k is the torque 
constant. This system can be considered as a prototype of 
many applications such as power systems, mechanical systems, 
network systems, etc. Therefore, the Lagrange stabilization 
of this system suggests many potential applications of the 
proposed method. Suppose that the measurements consist of 
the angular velocity of a pendulum and the angular difference 
between any two neighboring pendulums. As a result, all abso- 
lute positions of the pendulums are unobservable. Also, our A 
matrix has a single zero eigenvalue which is an unobservable 
mode of the system. Hence, Assumption 14.11 is satisfied. Let 
xi = 9i, X2 — Oi, xj, — 02, X4 — 02, xs — 03 and xg = 03. Then, 



the system can be described by the state equations of the form 
(|5]l with the following matrices and nonlinearities 



Bi = 

C2 = 






1 














^1+^3 -«! 


-ki -ki 








1 





-ki 


ki+k2 -a2 k2 











1 


-ki 


-k2 k2+k3 


-«3 


1 






r 1 






1 






1 







1 


, B 


= ^ 



1 


1 


















1 






1 







10 

10 , D 

10 

10-100 
1 0-1 
0-1 



12 



£1/3, 



D2i^£2h, and 0(z) = [ sinzi sinz2 sinz3 ]^. (30) 




i.^^'^-^'^W^ 



■^^-^, 



^^^^^^3333. 



k3 




Fig. 2. A system of three pendulums connected on a ring by torsional springs. 

Note that this system has multiple nonlinearities and thus 
the results of Q, HH-CHl cannot be appHed. Also, the 
nonlinearities do not have the special structure required in IS) 
to apply the result of that paper. 

The damping coefficients are ai = 0.1, a2 = 0.05, a^ = 
0.08. The torque constants are ki = 0.02, k2 == 0.03, k^ = 0.05. 
Also, we specify the constants j3 = 0.2, 7= 0.5, £1 = £2 = 0.1. 
It is easy to verify that the system (|5]), (l30] l satisfies Assump- 
tion 14.11 Also, all of the coefficients of the system (|5]l, (l30l ) 
are rational. We choose To = 2;r to ensure that Assumption 
14.21 is satisfied (T will have rational elements in this case). 
Therefore, Theorem 14. II is applicable to the system. Choosing 
Ti = 0.4, T2 = 0.6, T3 = 0.5 and A — 0.5 and solving the 
Riccati equations (fTsl l and ( fT9] l gives solutions which satisfy 
all of the conditions of Theorem 14.11 Therefore, the solution 
to Problem 1 for the system (|5]l, ( |30] | can be constructed using 
this theorem. To illustrate the fact that the resulting controller 
is such that the closed-loop system is Lagrange stable, a series 
of simulations has been carried out with different initial values. 
These simulations have confirmed that the trajectories of the 
closed-loop system are bounded. This can be seen in Figure 
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Fig. 3. System state responses and controller state responses of the closed- 



loop system for initial values \x\ (0), 
= 0,( = 1,--- ,6. 



.-^6(0)]' =[- 



-5] and 



[3] which shows the state responses of the system and the 
controller state responses for one set of initial conditions, 
when the output feedback controller is applied. In addition, 
our simulations reveal that the trajectories of the closed-loop 
system converge. Using Theorem 1 in fTT] and the results 
in |1), it can be verified that the closed-loop system has the 
property of dichotomy and the gradient-like property, which 
explains the observed convergence. 

VIII. Conclusions and Future Research 

This paper has studied the Lagrange stabilization problem 
for nonlinear systems with multiple nonlinearities. In order to 
facilitate the controller synthesis for these systems, a pseudo- 
Hoo control theory is developed. Sufficient conditions for the 
solution to state feedback and output feedback pseudo-i/00 
control problems are given. However, corresponding necessary 
conditions are yet to be obtained. The pseudo-Hoo control 
theory is applied to solve output feedback and state feedback 
Lagrange stabilization problems for nonlinear systems with 
multiple nonlinearities. The efficacy of the method is illus- 
trated by an example involving coupled nonlinear pendulums 
on a ring. 

This paper has considered the case where the nonlinear 
system contains decoupled nonlinearities. That is, as illustrated 
in Figure[Tl we consider independent scalar nonlinearity blocks 
each subject to a sector bound constraint. One possible area 



for future research is to extend the approach of this paper to 
enable the consideration of nonlinear systems with coupled 
nonlinearities. This would involve allowing the nonlinear 
blocks in Figure [T] to have vector inputs and outputs and 
to replace the sector bounds by more general local quadratic 
constraints. 

Appendix 
A. Proof of Lemma 12.71 

First note that /?, 7^ since A, ^ 0. From the conditions of the 

lemma, we have Eid — Ai — . From ^ and the fact that ^p is 

Pi _ Pi 

an integer, it follows that (j)i{t,Cid + Cix) - '^■1* A. 31 
<j)i{t,Cix). As Ad = 0, it follows that. 



--(j)i{t,Aif:p + Cix)- 



A{x + d) + '^Bi^i{t,Cid + Cix) =Ax + £^,-(f,C;x), (31) 

i=l !=1 

for all X and t. 

Consider an arbitrary solution x{t,to,xo) of the system ([U, 
(|2|l. Let x{t) =x{t,to,xo) +d for t > Iq. Then, x(fo) =xo + d. 
Also, it readily follows from dSTT i that x{t) = x{t,tQ,X()+d). 
Furthermore, the local Lipschitz condition impUes the unique- 
ness of this solution. Then, we have x{t) = x{t,to,xo+d) = 
x{t,to,xo)+d. Hence, the lemma follows. D 



B. An Outline of the Proof of Lemma \2.2\ 

Define ^(x,<^) = Y!l,Xi{-iir'^i-Qx)* {iir'^i~Qx) 
where ^ G "i"" and x ^^" are arbitrary complex vectors. 
Clearly, there exist constants 5 > and < U < 1 such that 

B^ 



c 



2u 



{{-j(0-l)I-A^) ^C^M,C{Uco-^)I-Ay^ 



2v i ' 



c 



-rM^-'M,M^-'<^-C*C 



< 



Given co G ^, we define 

a = {Uco-X)I-A)-'[B (^YlK 



(32) 



and 



fa{a,Q = ^*C^M,Ca-CM„C, 



it follows from 



where ^ 



and Ma = 
that 



M^'M.M^' 



Therefore, 



% (a, C) < -i^C*MaC, ycoe^,Ce '^'"+". 



(33) 



Furthermore, since Ma is a positive definite matrix, the in- 
equality (I33]l implies that % (^, C) < 0, for all C e '^"'+" such 

that ll^ll 7^0. Also, the pair {A,[B J j^I„xn]) is controllable. 



IEEE TRANSACTION ON AUTOMATIC CONTROL, MANUSCRIPT FOR REVIEW 



Using Theorem 1.11.1 in |T|, it follows that there exists a 
Hermitian matrix P ^ P* satisfying 2x*P{{A + Xl)x + Bt, + 

IjC) + o*C'^M^Ca -~£,*M^^MrM^^£, - C*C < 0, for all 
xe'rf", C = [<^^ C^]^G'^"'+" such that ||x|| + ||^ |1 + ||C|1 7^ 0. 
Letting C = 0, this implies that there exists an n x n matrix 
P = P^ such that 



Using the equation A'^P + PA + C^C = 0, it follows that 



2x*P [Ax + B^]< -2Xx*Px - ^ (x, (^ ) 



for all X G ^", ^ e "tf'" such that ||x|| + ||<^|| ^ 0. Letting 
(^ = in ( I34I 1. we obtain that there exists a r > such that 
2x^P [A + Xl]x< -rx^x < 0. 

Note that the pair {A + Xl, rl) is observable. Since the matrix 
A + 1/ is pseudo-Hurwitz, then using Theorem 3 in ifTSl gives 
that P is pseudo-positive definite. 

In a similar way to the proof of Theorem 2.6. 1 in 1 1 1, we can 
prove that the set {x G ^" : x^Px < 0} is positively invariant 
for the nonlinear system ([T]), (|2|i, (O and further prove that the 
solution x{t,to,xo) of the system ([T]i, (|2]), (O is bounded. D 



C. Proof of Theorem 15.71 

In order to prove Theorem l3.1l some preliminary results are 
required. 

Lemma A.l: Suppose the pair {C^A) has no unobservable 
modes on the j(0 axis. If the Lyapunov equation A^P + PA + 
C^C = has a pseudo-positive definite solution P = P^ , then 
the matrix A is pseudo-Hurwitz. 
In order to prove Lemma IaTI we require the following results: 

Lemma A.2 ( [19]): Let ^ be a symmetric matrix of the 



form P 





pT 

M2 



Pl2 

hi 



, where P22 = P22 ^"d Pj2 ^^ n2 x 



«2 and n2 X «! matrices, respectively. Also, let k — rank(P[^) 
Then 



In(P) = In(P22/ker(A2)) + {k^ni-k), 



(35) 



where ker(Pi2) == {C e K'" : P12C = 0} and P22/ker(Pi2) rep- 
resents the restriction of P22 to ker(Pi2). 

Lemma A.3 ( [200: If A e ^"''" and if A,^ £ C7(A) are 
eigenvalues of A where X ^ pL, then any left eigenvector of A 
corresponding to /i is orthogonal to any right eigenvector of 
A corresponding to X. 

Proof of Lemma \A.1\ The Kalman decomposition ||T6| 
establishes the existence of a matrix T which Jransforms tlje 

matrix pair {A^C) into the form A = TAT^^ = 

C = CT^^ ~ [0 C2] where the pair (A22,C'2) is observable. 
The dimensions of the blocks in the above decomposition 
ai-e as follows: An e .^"i^"'. An e ^"'^"2, A22 G ^"^''"z, 
and the column dimension of C2 is «2- Correspondingly, let 



j-ipj- 



Pu 

pT 

M2 



Pn 
P22 



It follows from the observ- 



ability of (A22,C2) that there exists a matrix K such that 
8{A+KC)^0. 



.pTJT 



A[iA_i+jPiiAn_ 

^12-fll +^22-^12 

PuAn + PiiMi+MiPn 
Pn^n +AI2P12 + P22A22 +AI2P22 



-CIC2 



= 0. 



(34) Hence, 



AfiAi+AiAn-O. 



(36) 



(37) 



Claim 1: If the pair {C,A) is such that there exists a matrix 
K satisfying 5{A+KC) = 0, then ReA(An) ^ for VA G 
cT(An). 



To establish Claim [T] we rewrite K ?& K = 



A + KC = 



K2 



Then 



If there exists an eigenvalue 



An Ai2 + KiC2 

A22 + ^2C2 

of An such that ReA(An) ==0, then A+KC obviously has 
purely imaginary eigenvalues. This contradicts the fact that K 
is chosen so that 8 {A+KC) =0. Therefore, ReA(An) 7^0. 
This completes the proof of the claim. 

Combining Claim [T] and ( |37] ) gives that P\\ =0. Also, the 
(1,2) block of (O imphes that 



A2A22+AnPi2-0. 



(38) 



As P is nonsingular, this implies that PnPfj > 0. Apply- 



ing Lemma IA.2I to P gives that In P = In(P22/kerPi2) + 
(rankPj^,rankPj^,ni — rankPj^). It is known that InP — 
(« — 1, 1,0). This implies that 

1) = 5{P) = 5 (P22/kerPi2) + ("i -rankPfj)- For Pf, ^ 
^niX'H^ it always holds that rankPfj < "i- Then, 
5(P22/kerPi2) < 0. So, 5 (P22/kerPi2) =0 holds. This 
further implies that «i — rankPj^. Also, the condition 
5(-P22/kerPi2) =0 implies that the matrix -P22/kerPi2 is 
nonsingular and has no purely imaginary eigenvalues. 

2) 1 = v{P) = V (P22/kerPi2) +rankPj^2- Hence, rankPj^2 ^ 1 
and PnPn > imply rankPj'j = 1 and v (P22/kerPi2)"= 0. 
Hence, P22/kerPi2 = S^P22S is symmetric and positive 
definite, where the columns of S form a basis for kerP^. 

3) Finally, the identity n{P) = n - 1 = n: (P22/kerPi2) + 
rankPj^ implies ;r(P22/kerPi2) —n — 2. 

Therefore, it follows that rti — I. Hence An is a scalar, P12 is 
a row vector of dimension n — 1 , and P22 isa(n— l)x(« — 1) 
matrix. The dimension of S^P22S is equal to n — 2. 

As P12 e ^^""^"^^l Pn 7^ 0, dig implies that -An is an 
eigenvalue of A22 and P12 is the corresponding left eigenvector. 
Now, let A be any eigenvalue of A22 such that A ^ —An and 
let ^ be a corresponding right eigenvector; that is, A22^ = Xq. 
Then Lemma lA.31 implies that Pi2^ = 0. Hence, q G Ker P12. 

Pre- and post-multiplying the (2,2) block of (|36] l by q^ 
and q respectively implies that q^P22A22<l + 1^A22P22<1 + 
q^ClC2q = 0. Therefore, Xq^ P22q + ~Xq^ P22q+ llQ^f = 0. 

Using the fact that a — q'^ P22I is positive on KerPi2, we 
have 2aRe(A) + ||C2^|P = 0. Since ^ 7^ is an eigenvector of 
A22, C2q 7^ 0. Therefore, Re(A) < 0. 

The above derivation shows that all eigenvalues of A22, 
possibly with the exception of —An, have negative real part. 
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Therefore, if —An is negative, then A22 is Hurwitz; if —An is 
positive, then A22 has all the eigenvalues X ^ —A 1 1 negative 
except —All. 

Now, we can conclude that the spectrum of A is a{A) — 
{—All, All and A : A 7^ — Aii,ReA < 0}. Also, since the pair 
(C^A) has no unobservable modes on the imaginary axis, 
it follows that A\\ 7^ 0. Hence, A is pseudo-Hurwitz. This 
completes the proof of Lemma I A. II D 

Proof of Theorem 13.71 By assumption, P is such that 

5{A+BB'^P) = 0. Letting C = ^ J" , K^[B ], it 

follows that A+^C is such that 5{A + KC) = 0. Therefore, 
(A+KC^C) has no unobservable mode on the imaginary axis 
and hence {A,C) has no unobservable mode on the imaginary 
axis, either Applying Lemma lA.ll to the Lyapunov equation 
A^f + PA + C^C := 0, it follows that A is pseudo-Hurwitz. 
Hence, det(;'a)/-A) ^ for all (O e^.. 

Now, we show that Q holds. Since A is pseudo-Hurwitz, 
then det(ja) -A) 7^ 0, Vo e ^. Hence, dHJ implies that 

G{~j(oYG{j(o) = 

I -[I- B'^P{-j(0l-Ay^Bf[I - B^P{j(0l-Ay^B] 



<I 



(39) 



for all CO > 0. It follows that max{Gmax[G{j(o)G{- jco)^]} < 

1. Furthermore, note that G{jco) — > as o ^ 00. 

Now suppose that there exists an d) > such that 

max{a,„cix[G{~jco)'^G{jco)]} = L It follows from ^ that 
fl) 

there exists a vector z such that [I — B^P{ja) —A)^^B]z = 
0. Hence, det[/ - B^P(yd) — A)"'B] =0. However, using a 
standard result on determinants, it follows that det[ja)I — 
A - BB^P] = detyCbl - A]det[/ - B^P{ja)I - A)-^B]. Thus 
det[ja)I — A — BB^P] = 0. This conclusion contradicts the 
assumption that 5{A+BB^P) =0. Hence, d?) holds. D 



D. Proof of Theorem \3.2 



Let fl 



= max|(7,„ 



{-j(aI-A')-'C'CU(aI-A)-']} 



It follows from (Q that there exist an e > such that 
GUco)GU(of < (1 -£)/. Hence, ^C{jcoI -A)-H~j0)I - 
A'^y^C'^ < §/ for all co > 0. Then, given any a > 0, 
C{j(Ol-A)-^BB^{~jcoI-A^)-^C^ < (l-J)/, where B is 
a non-singular matrix defined by BB^ =BB +£/2jx^L This 
further implies that 



B'^{-jcoI-A 


'r'c 


^Cijcol-A)- 


-'B<[l- 


-f)^ 


(40) 


for 

A^r 


all CO > 
^C^CiJcoI - 


0. 

- A)- 


Let 


Hence, -^ 




jcol - 
jcol - 


A^r 


'iJ(OI-A)- 


'B < 


f/. 


holds 


for all ta 


> 


. From 


m, 


it follows that given an) 


t (0>Q, 












G{- 


-j(oy 


'Gijco) 


</ 




(41) 



where G{s) = C{sl—A) ^B with C being a non-singular matrix 
defined so that C^C = C^C + (e/2T] 2)/. Furthermore, fiTT i 
implies G{jco)G{-jcoY </. 



Since A has no eigenvalue on the jo-axis and the pair 
{A,B) is stabilizable (since it is controllable), it follows 
from Theorem 13.34 in [101 and (|4TI) that there exists a 
right coprime factorization G{s) — N{s)M^^{s) such that 
M{s) e ^J^oo is an inner transfer function matrix where 
Ails) :^F{sI-A-BF)-^B+I eMJfoo, ffis) ^C{sI~A~ 
BF)-^B e ^Jf «, with F = -B^X, and the Riccati equation 
A^X +XA- XBB^X == has a solution 1 > such that 
A — BB^X is stable. Since M{s) is an inner transfer function, it 
follows that N{jco)N^{-jco) = G{jco)& {-jco) < L Apply- 
ing the bounded real lemma (e.g., see |7|), the above condition 
is equivalent to the existence of a stabilizing solution to the 
Riccati equation 



{A~BB'XYP + P{A-BB'X)+PBB'P + C'C = Q. (42) 
Let P^P — X. Then substituting this into ( |42] | gives that 



vT ddTv^ 



(A'X+XA-X'BB'X) 



{A'P + PA 



PBffP 



-C'C)=Q. 



(43) 



Therefore, gS implies that A^P + PA + PBB^P + C^C + 
Y-iP- + Y^l = 0. This implies that P = P satisfies ^. This 
proves the first claim of the theorem. Now we prove the second 
claim. 

From (|7]l, it follows that G{jco)G^{-j(o) < L As the pair 
(A,B) is stabilizable. Theorem 13.34 in ifTOl implies that there 
exists a right coprime factorization G{s) — N{s)M^^{s) such 
that M{s) G ^J^oo is an inner transfer function matrix where 
M{s) ^F{sI-A~BF)-^B+I e^Jf^, Nis) ^C{sl-A- 
BF)-^B £ ^Jf^ with F = -B^X, and the Riccati equation 
A'^X +XA- XBB^X = has a solution X >0 such that 
A — BB^X is stable. Since M{s) is an inner transfer function, 
it follows that NUco)N^{-j(o) = G[jco)G'^ {-jco) < L Ap- 
plying the bounded real lemma \J\, the above condition is 
equivalent to the condition that the following Riccati equation 
has a stabilizing solution 

(A - BB^XfP + P{A - BB^X) + PBB^P + C^C = 0. (44) 

Let P = P — X. Then substituting this into ( |45] l gives that 

{A'^X+XA-X'^BB'^X) + {A'^P + PA+PBB'^P + C'^C)=0. (45) 

Therefore, the Riccati equation (|8]l has a stabilizing solution. 
Furthermore, as the pair {A,C) is observable, it follows from 
the Inertia theorem in 1 2 1 1 that the solution P ^ P^ of the 
Riccati equation ([8]l is a pseudo-positive definite matrix. This 
completes the proof. D 

Proof of Theorem 13.31 The Riccati equation ( fTOl l can be 
written as 

{A-B2E^^D\2CifP + P{A-B2E-^D\2Ci) 
+PBiBlP + Cj{I-Di2E{^Dl2)Ci 
-PB2E-^D\2{I~DnEy^D\2)Ci~PB2E^^BlP 



C[ [I -Di2Ey'D{2)DnE^'BiP ^ 



(46) 



As the Riccati equation ( fTOl i has a solution P = P^ which 
is pseudo-positive definite, the equation ( |46] | also has this 
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property. Substituting K 
implies that 



-E-^dIjCi+bIp) into gg 



{A+B2KfP + PiA+B2K)+PBiB{P 

+ iCi+DnKfiCi+DnK)=0 



(47) 



has a solution P — P^ which is pseudo-positive definite. 
Also, the fact that the matrix ( fTTT i has no purely imaginary 
eigenvalues implies that A + B2K + BiBJP has no purely 
imaginary eigenvalues. Therefore, it follows from Theorem 
13.11 that the resulting closed-loop system 

i = {A-B2E{^D\2Ci-B2E-^bIp)x + Biw, 
z = Ci-Di2E;^{d\2Ci+bIp)x 

is pseudo strict bounded real. This completes the proof of 
Theorem 13.31 D 



E. Proof of Theorem 13.41 

In order to prove Theorem 13.41 the following lemma is 
introduced. 



Lemma A.4: Suppose the conditions of Theorem 13.41 hold. 
Then, the matrix Z = il-YXy^Y =Y(I-XYy^ > is a 
stabilizing solution to the Riccati equation 



A^Z + ZAl- ZM.,Z + N^^Q 



(48) 



where A* 



-A~BiDl^E-^C2+Bi{I-DliE-^D2i)B\X,N, 



Bi{I - Dl^E^^D2iB-^), M, = (C2 + D2iBixyEy{C2 + 
D21BJX) - {BlX+DljCifEj\BlX+D\^Ci). 
The proof of this lemma is similar to that of Lemma 3.2 in 
IJH and is omitted. 

Proof of Theorem 13.41 We will prove that the compensator 
of the form (|6]l, (flST l makes the closed-loop system pseudo 
strict bounded real. In order to establish this fact, note that 
Lemma IA.4I implies that matrix Z = (/ - YXY^Y > is a 
stabilizing solution to the Riccati equation ( |48] l. Substituting 
{I-YXy^Y ^Z and [I -YX)-^ = (I + ZX) into O, it 
follows that the compensator input matrix B^ can be written 
as 

B,=ByDlyE^^ +Z{Cl +XBiDly)E^\ (49) 

We now form the closed-loop system associated with system 
(|5]l and compensator (|6]l. This system is described by the state 
equation 



z 



where 



I? 



A 



A+B2CC 

A-Ac + B2Cc-BcC2 

A 



At] 
Cri, 

X 
X X(^ 

-B2CC ' 

Ac-B2Cc 



Bw, 



(50) 

A 



B- 



A 



Bi 
-BcD2i 



and C = [ Ci +D12Q -DnQ \ . 

In order to verify that this system is pseudo strict bounded 
real, we first recall that Z > is a stabilizing solution to the 
Riccati equation ( |48] l. This implies that Z > will also be a 
stabilizing solution to the Riccati equation 



AqZ + ZA'q+ZQCoZ- 



-BqBq 







(51) 



where Aq = A - BiDl^E2^C2 +Bi{I - dI^E^^^ D2\)B\X - 
Z{C2 + D2xB\xYE^'{C2 + D2xB\X), Bq = 

By{I - Dl^E^^D2l) - Z(C2 + D2xB\xYE^'D2U 

CQ=E\{BlX + D\2Ci). 

Let W = Z^^ > 0, then the Riccati equation ( BTT i leads to 



aIw + WAo + WBqBIw + CICq ^ 0. 



(52) 



Now, we prove that W = W^ is an anti-stabilizing solution of 
(|52] |. Using the Riccati equation ( |52] |. it follows that — (Ao + 
ZCjCo) ^Z{AI+Z-^BqBI)Z-\ Hence the matrix -(Aj + 
ZCqCq) is similar to the matrix {Aq+BoBqW)^. Since Z is 
a stabilizing solution to ( BTl i. the matrix Aq + ZCqCq must 
be Hurwitz and hence the matrix Aq + BqBqW must be anti- 
Hurwitz; i.e., W is an anti-stabilizing solution to ( |52] |. 



Now, we define E 



As X is pseudo-positive 



A X 

w ^ 

definite and W > 0, it follows that E is also pseudo-positive 
definite. Using equations ( fT3] l. ( fTSl l. (|49] l, (|52] |. it is straight- 
forward to verify that E satisfies the Riccati equation A^E + 
EA + ESS^E + C^C = 0. Furthermore, it is straightforward to 

verify that A+BB^E 



A-B2E- 

B2Ei 

D\)Z'W 



'^[2^ 



^^[2^ 



'An 



An 
Ao+BoBlW \ 


where An 


1 ^2 


-BiB\)X, An ^B2E^^Bl 


'^Ix^i 


'£>2iKW -BiDl^E^\C2 



Ci - (B2£i 
Ci + Bi(/ - D^iii7'D2i)Bj W - BiD^iii7'(C2 + 
2\)^yy ■ Using the fact that X is a stabilizing solution to 
(fT3T l and W is an anti-stabilizing solution to ( |52] |. it follows 
that A + BB^T. has no purely imaginary eigenvalues. We 
have noted previously that the matrix E is pseudo-positive 
definite. Therefore, using Theorem 13. II we conclude that the 
system ( fSOl l is pseudo strict bounded real. Using the fact that 

X 

, it follows that the closed-loop system 



ri 



I 
/ / 



X 
Xc 



A B2Cc 
BcC2 A, 





X 




+ 


Bi 
_ BcD2i 


X 








Xc _ 









w; 



= [ Ci DnCc ] 



is also pseudo strict bounded real. This completes the proof 
of Theorem [331 □ 



F. Proof of Theorem \3.5\ 

Consider the system described by the state equations 

X = AX + B2U+B1W, 

z = Cix + Dnu, 
y = C2X + D21W, 



(53) 



where 

A 
C2 
Let 



A , Bi — Ci , B2 = C2 , Ci — Bi , Dn — £>2i ^ 



B2, D21 =£>12, 



(54) 



Ei=Dl2Dn=E2, E2=blrb2i^Ei, X^Y,Y^X. (55) 

Substituting the matrices in ( |54] i and ( |55l l into Conditions 
(i), (ii), (iii) of the theorem gives that the system ( |53l ) satisfies 
the following conditions of Theorem 13.41 
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(i') The Riccati, as shown below, has a pseudo-positive 
definite stabiUzing solution 



{A-B2El^b\2CiYx+X{A-B2E^^b\2Cx] 
+X{BiBI-B2Ei^bI)X 
+Cj{I-DnE{^Dl2)Ci=0. 



(56) 



(ii') The following Riccati equation has a positive definite 
stabilizing solution 



(A- 



BtDLEr^^'^'^ 



1^21^.2 C2)Y + Y{A-BiD'2iE2'C2y 



+Y{CiCi^CiE^'C2)Y 
+Bi{I-bl^E^^D2i)B\^Q 



(57) 



(iii') The matrix XY has a spectral radius strictly less than 
one, p{XY) < 1. 

Using Theorem 13.41 it follows that there exists a dynamic 
output feedback compensator of the form Q such that the 
closed-loop system consisting of the system (l53T l and this 
compensator is pseudo strict bounded real. The parameters 
of this compensator are as follows: 



Since 



is non-singular, it follows that 
0. Using this fact and Assumption 



/ 

T 

Ac BcC2 ' 

B2Cc A \ 

14.11 it follows from Lemma IZTI that the resulting closed-loop 
system ( l59l l is pendulum-like system with respect to the set 

n(To^ii). 

From the output feedback pseudo //« control 
theory in Section III, Conditions I, II, III of the 

B2Cc 

Xl+Ac 
is pseudo-Hurwitz and the 

< 



theorem imply that the matrix 



Xl + A 

BcC2 



max Ginax [G {-jco)G{jco)] 



frequency-domain 
1 holds, where 



and 



here 

-1 r 



condition 

G(-) is 

A 



Gcis) 
Bi 
BcD2i 



defined as G{s) = MiGcis)M, 

[C, DnCc \[s-^ ^^^^ ^^^^ 

Then, it follows that Gl{-jco)MrGc{j(o) < M, 
all o e ^. Now, all the conditions of Lemma ul2] are satisfied 
and hence the closed-loop nonlinear system (|59] l, Q, (O, ^ 
is Lagrange stable. D 



^"M M.M^ 



for 



Ac 
Be 

Cc = -E^\B'2X + D[2Cx) 



A+B2Cc-BcC2 + {Bi -BcD2i)B{X, 
{I -YX)-\ycI +Bxbl,)E2\ 



(58) 



[B\ Dl.Bl ][sl- 



-1 






Substituting the matrix in ( l54l i and (|55] | into dSSl l. the 
transfer function of this closed-loop system becomes G{s) = 

A^ ClB] 
. .^Bl Al ^^ 
Consider the system (|5]l with compensator 
rameters are determined by ( fTSI ). It is readily seen that the 
transfer function of this closed-loop system G{s) satisfies 
G{s) = G^ (s). Therefore, from the fact that the system ( l53T l. 
( l54l l. dSSl l. dSSl l is pseudo strict bounded real, it follows J;hat 

^ ^ [a 

max amax[G^{-j(o)G{ja))] < I. Also, 



(|6]l whose pa 



B2Cc ' 



BcC2 Ac 
and is pseudo-Hurwitz. Hence, the closed- 
(|6]l, (fT6] l is pseudo strict bounded real.D 



A B2Cc ' 

^ BcC2 Ac 
loop system Q,' 



G. Proof of Theorem \4.1\ 

We first prove that the closed-loop system 



if 
i 


= 


Ac BcC2 
B2Cc A 


Xc 
X 




+ 


BcD2i 


z = [ DnCc C\ ] 


Xc 
X 


1 





w, 



(59) 



obtained by substituting the controller ^, (l20l i into the system 
©, is pendulum-like. Let J = [ Oix„ e'^T'^ ]^. Note the 
identity 

-1 



-'(2n-l)xl 
1 



/ 
T 






Ac BcC2 
B2Cc A 


= 




Ac 
B2«( 
B2bC 


BcC2a 

:c Ai 
:c A2 



H. Proof of Theorem 15.71 

We first prove that the closed-loop system ( |59] l, obtained 
by applying the compensator ^, ( l22b to the system Q, is a 
pendulum-like system. 

/ 



Since 

Ac 

B2a 



-1 






f 



BcC2a 

Ai 

Ix(n-l) 



T 

BcC2b 

A2 





Ac 

B2Cc 

do 
1 



BcC2 

A 
= 



and 



non-singular 

Using 



matrix, it follows that 



d = 



this fact and Condition 



Ac BcC2 

B2Cc A 

rV of the theorem, it follows from Lemma 12.11 that the 
augmented closed-loop system (|59] l, (HJ, (|3]l, (|4|i is a 
pendulum-like system with respect to Yl{pTod). 

Using the output feedback pseudo Hoo control theory given 
in Section III, it follows from Conditions I, II and III of 
the theorem that the closed-loop system (|59] | is pseudo strict 
bounded real. In a similar way to the proof of Theorem l4.1l we 
have G^{-j(0-X)Mt:Gc{j(0-X) kM^^M^M^K Now, using 
Lemma 12.21 it follows that the closed-loop system ( |59] l, Q, 
(O, dUi is Lagrange stable. D 



I. Proof of Theorem 15.21 

The stabilizing solutions to the Riccati equations ( fTSI l and 
( fT9l l are functions of the vector of constants f . To highlight 
this, we use the notation X{f) and Y{f). In the proof of 
Theorem 15.21 we use the following lemma: 

Lemma A. 5: The nonsingular stabilizing solutions X{t) and 
Y{t) to Riccati equations ( fTSl l and ( fT9] l are real analytic 
functions on the set T. 
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Proof: As X{t) is nonsingular, we can rewrite the Riccati 
equation JTSl) as 



-B2E-'^bIx{t) 



-x-Hf) 



{Xl + A-B2E-^D\^M^CiY+ 
Cj{M,-M,Di2Ei^D'{2Mr)CiX-^{T) 
xX{f). (60) 



As X{t) is a pseudo-positive definite stabilizing 
solution to the Riccati equation ( fTSl ). it follows that 
the matrix -{Xl + A - B2E^^D'{2M-,CiY - Cf (M^ - 
Mt:D\2E^^D\2Mz)C\X'^{x) is Hurwitz and hence 
the pair (-(A/ + A - B2E^^D\2MtCiY ,-C\{Mr - 
MrDi2E{^D\2Mr)Ci) is stabilizable. 

The Riccati equation ( fTsT i can be written as 

X-\f){Xl +A - B2E^^D\2MrCif 

+ {Xl+A-B2E^;^D\2MrCi)X-\T) 

+{b,m^m-'m^b\-B2E^^bI) 

■^X-\x)C\{M^-M^DnE^^D\2MT:)CiX-\T)^Q. 

(61) 

Substituting the matrices —(A/ + A — 



B2E-'D[2M,CxY 
-BiMf,M-^M^Bj 



B2E-^ 



Bl 



MrDi2E{'D{2Mr)Ci 

i[ 2^2 into A, R and Q of 
Theorem 2 in |[22l . respectively, it follows that X^'(t) 
is the maximal solution for all solutions of the Riccati 
equation dSB- Since Cf (Mr -MTZJnfir'ZJfjMt)^ >0 and 
-BiMf^M-^M^Bj +B2E{^Bl is Hermitian, Theorem 4.1 in 
||23J is applicable. Using Theorem 4.1 in |,23J by substituting 
-{XI +A -B2Ey^D\2M^CiY, Cj{Mr -MrDnE^^Dj^Mr)^ 



and -BiM^M-^M^Bj + B2E^^B'2 into A, R and Q, 



respectively, gives X^' (t) is a real analytic function of T G T. 
This further implies that X(f) is a real analytic function 
of f e T. Similarly, we can verify that Y{f) is also a real 
analytic function of T e T.D 

Proof of Theorem \5.2\ Let e > be chosen to be sufficiently 
small so that the set B(f,e) = {f e ,:%'" : \\f - t\\ < e} C 
{f e F : Condition I, II and III of Theorem ED holds} . The 
existence of such an £ > follows from Lemma IA.5I 

Since X{f) and Y{f) are analytic function on the set T, it 
straightforward to verify that /(f) is an analytic function on 
the set F. Since A^' is a diagonal positive definite matrix, 
it follows that Condition II of the theorem implies that 
det7(f) / 0. Let c — f{f). It follows from the Inverse Function 
Theorem (e.g., see Theorem 7.8 in 1241 ) that there is an open 
ball B(c,i) and a unique continuously differentiable function 
g from B(c,i) into B(f,e) such that i — g{c) and f{g{c)) —c 
for all cgB(c,i). 

Since the set of rational vectors =S"' is dense in ^"\ we can 
choose c G B(c, i) such that all the elements of c are rational 
and non-zero. Also, it follows from the above discussion that 
there exists a point f e B(f, e) such that /(f) = c where f = 
g{c). Therefore, Condition IV of Theorem 15. II is satisfied. 

It follows from the definition of B(f,e) that f satisfies 
Conditions I, II and III of Theorem 15.11 Hence, Theorem 



15.11 implies that the corresponding closed-loop system is 
pendulum-like and Lagrange stable. D 



J. Proof of Theorem \6.1\ 

Substituting the controller law ( |29] l into the system ( |5al ), 
( |5b] i gives the closed-loop system 

i = {A-B2E-'^D\2M.,Ci-B2E^^bIx)x + BiB,, 

z = {{l-DnE^^D\2M,)Ci-DnE^^Blx)x. (62) 

Since J-^A - B2E{^Dj2MrCi - B2E^^BlX)d = 
(A - B2E-^D\2M^C\ - B2E-^BlX)d = 0, it follows that 
{A-B2E^^D{2M-,Ci -B2E^BlX)d = 0. Using this fact and 



condition II, it follows from Lemma 12.11 that the closed-loop 
system ( l62b is a pendulum-like system with respect to 

n{pTod). 

Using the fact that the Riccati equation ( fTSl l has a pseudo- 
positive definite solution and Condition I holds. Theorem 
13.31 implies that the closed-loop system ( |62] i is pseudo strict 
bounded real. Then, using Lemma 12. 2[ it follows that the 
closed-loop system ( |62] i, ( |5b] l, (|2]l, ^, ^ is Lagrange stable. 
D 
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